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Abstract 

> 

o 

After a rapid introduction to the physical motivations and a succinct 
presentation of heuristic results, this survey summarises the main math- 
ematical results known on the Edwards- Anderson and the Sherrington- 
OQ Kirkpatrick models of spin glasses. Although not complete proofs but 

ON rather sketches of the relevant steps and important ideas are given, only 

results for which complete proofs are known — and for which the au- 
,__! thor has been able to reproduce all the intermediate logical steps — 

are presented in the sections entitled 'mathematical results'. This pa- 
per is intended to both physicists, interested to know which articles 
among the multitude of papers published on the subject go beyond the 
C heuristic arguments to obtain rigorous irrefutable results, but also to 

' the mathematicians, interested in finding out how rich is the physical 

^ intuitive way of thinking and in being inspired by the heuristic results in 

O view of a mathematical rigorisation. An extended, but not exhaustive, 

^ bibliography is included. 
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1 Introduction and physical motivations 

Equilibrium statistical mechanics of translationally invariant (or periodic) systems is well un- 
derstood; although particular problems can be very hard or impossible to solve analytically, this 
discipline provides a scheme for the treatment of problems arising in condensed matter physics 
on which we can confidently rely both mathematically and numerically. From the mathematical 
point of view, equilibrium statistical mechanics is a logically closed theory that explains the 
regularity of thermodynamic quantities and the phenomenon of phase transition; it achieved 
its ultimate stage thanks to the works of Dobrushin [36] and Lanford and Ruelle [87]. 

Several physical systems fail however to fulfill the translation invariance (or periodicity) 
condition; these systems fall into two classes: quasiperiodic (like quasicrystals) and random 
systems (like spin glasses). Although systems in these two classes share some common features, 
their treatment is not yet unified. In this review, attention is paid only to random systems; 
readers interested in quasiperiodic systems may consult [57, 84, 103, 45] for some partial results. 

Spin glasses are systems whose translational invariance is broken by the presence of frozen 
randomness. It is not clear what is meant by 'frozen randomness'; it was originally believed 
that this randomness can evolve under the dynamics to some non random interaction. Nowa- 
days, it is generally accepted that this randomness is deeply frozen and cannot evolve. From a 
fundamental point of view, it is however questionable whether equilibrium statistical mechanics 
is the appropriate framework for their study since these systems are stricto sensu not in equi- 
librium but in some relaxing metastable state. For instance, the ordinary industrial glass is a 
metastable (but not random) state of silicium dioxide that can be also found in nature under 
two other stable phases: quartz crystals and sand. Visiting any museum exhibiting objects 
from the classical antiquity can convince you however that the relaxation time needed for the 
transformation of glass into one of its stable phases exceeds historical times and so the use of 
equilibrium statistical mechanics, although it might be only an approximation, is 'ontologically' 
justified for the study of glasses. The more recent belief is even that the spin glasses are not 
metastable systems and cannot thermodynamically evolve. 

Like glass that are deterministic non translationally invariant deterministic systems, spin 
glasses are non translationally invariant magnetic systems with frozen randomness. After some 
controversy, in the beginning, about which objects should be designed by the vocable spin 
glasses, it is generally accepted, nowadays that they fall into three categories [8]. 

Non-stoicheiometric alloys: these are typically alloys composed by a nonmagnetic atom of a 
noble metal (like gold, platinum, cooper or silver) and a magnetic atom of a transition metal 
(like iron or manganese) in a proportion not satisfying chemical valence saturation, eg Aui^Fe^. 
There is a periodic matrix-crystal of gold but a proportion x of the crystaline sites, randomly 
scattered through the lattice, are occupied by iron. The magnetic interaction is only between 
the magnetic (transition) atoms and has the form </(|r|) = J C °/ S , ,^3 , where kp is the Fermi 
wavenumber, J a constant depending on the nature of the metals in the composition of the 
alloy, and r the distance between the magnetic atoms. Since the magnetic atoms are not 
occupying periodically the sites of the nonmagnetic matrix-crystal, the effective interaction has 



"randomly" alternating signs. 

Random occupation of crystal sites: these are non stoicheimetric ternary alloys of the form 
Eu^Sri-^S (where the sulfur atom can be replaced by selenium or tellurium). Again there is a 
periodic crystalline structure but the magnetic atoms are randomly scattered through the lattice 
sites. The magnetic interaction is between europium and/or strontium and is ferromagnetic 
(positive) when these atoms are neighbours and antiferromagnetic (negative) when they are 
next nearest neighbours. 

Amorphous structure of material: these are noncrystalline alloys of the form Alo.63Gdo.37 where 
the atoms of aluminium and gadolinium are at random positions in the space. 

All these materials exhibit similar thermodynamic behaviour, ie some features are sample 
independent and some other are sample dependent (random). For instance, in the figure below 
is plotted the real part of the magnetic susceptibility x as a function of temperature T for an 
Eu^Sri-^S alloy. 
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Figure 1: Qualitative behaviour of the real part of the magnetic susceptibility Rex, as a 
function of temperature T. A cusp-like singularity is observed for T c . 



This function has a cusp-like singularity at a critical temperature T c that is sample inde- 
pendent. Similarly, in the following figure is plotted the order parameter q as a function of 
temperature for an Alo.63Gdo.37 alloy. 
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Figure 2: Qualitative behaviour of the order parameter q, as a function of temperature T. 
An infinite slope singularity is observed for T c . 

Again, the value of the critical temperature is sample independent. 

Having in mind the previous observations, it is clear that any reasonable theoretical model 
for spin glasses, must include the main structural features of these systems and reproduce the 
qualitative experimental behaviour. 



Models proposed for spin glasses and formulation of 
mathematical problems 



In view of the physical properties of spin glasses, it seems reasonable to introduce random 
interactions. But the real systems are so complex that realistic models of randomness are quite 
intractable both mathematically and numerically. For this reason — as usual in mathematical 
physics — some simplified models mimicking the main features of real systems were introduced. 
Instead of giving a detailed description of all these models, a synoptic table with the relevant 
references and the main features of most of these models is given below. Neither the table nor 
the quoted references are exhaustive! 



Model 


Type 


Relevant references 


Random energy models 


u/na 


[33, 125, 55, 107, 119, 120, 82, 85, 21] 




Spin glasses on Cayley trees 


u/na 


[28, 27, 56, 62, 10] 




Multiplicative chaos and related models 


u/na 


[29, 117, 34, 17, 24, 133, 35] 




Random diluted ferromagnet 


u/d 


[91, 64, 49, 50, 6, 26, 60, 122, 38] 




Random field Ising model (d > 2) 


u/d 


[73, 72, 15, 2, 50, 47, 9, 23] 




Pastur-Figotin (Hopfield) model 


f/mf 


[113, 71, 116, 131, 132, 126, 13, 14, 80, 78, 5] 




TV-vector models 


f/mf 


[80, 43, 44, 121] 




SG with semiconvergent interactions 


f/d 


[124, 51, 52, 136, 137, 40, 41, 42, 69, 20, 18, 1 


L9, 80] 


SG on Voronoi lattice or percolation clusters 


f/d 


[46, 65, 7, 134, 6] 




Sherrington-Kirkpatrick model 


f/mf 


[127, 77, 1, 30, 83, 128, 32, 66, 67, 68, 31, 99, 


37] 


Edwards- Anderson model 


f/d 


[39, 115, 13, 129, 40, 81, 11, 12] 





Models are classified according to two criteria: their range of interaction and their frustration 
character. Concerning the range of interactions, we distinguish three classes (d, MF, and NA); D 
stands for decaying interactions, ie the absolute value of the interaction becomes smaller when 
the distance between the interacting magnetic atoms becomes larger; MF stands for mean- 
held interactions where the strength of the interactions keeps the same magnitude all over the 
sample; finally, NA stands for nonapplicable and it is used for some particular models defined 
on lattices without natural underlying metric structure (lattices not embeddable into R ina 
Lipschitz way). 

Frustration is a phenomenon occurring each time a binary relation that is reflexive and 
symmetric fails to be transitive, eg friendship is such a relation since (A and B friends) and 
(B and C friends) does not imply (A and C friends)! In the context of spin glasses, frustration 
occurs when interactions can take both signs and the spins live on a lattice with loops, like Z 
for d > 2. In the previous table, we distinguished two classes U and F according to the fact 
that the model is unfrustrated or frustrated. 

Two of these models, the Sherrington-Kirkpatrick and the Edwards- Anderson models are 
more precisely defined below and studied in the subsequent sections. Both models are defined 
on a configuration space Ejv = { — I,I} Ajv over a finite set of sites Ajy- Configurations are 
denoted a £ Ejv and <7 8 - £ { — 1,1} denotes the spin value over the site i £ Ajy- Eventually, the 
finite parameter N will be allowed to tend to infinity (thermodynamic limit). 



The Sherrington-Kirkpatrick model: is a mean-field model defined over the set of sites Ajy = 
{I, • • • , N}. We identify the dual lattice A* N of Ajy with the complete graph Kn = {{hj} '■ i £ 
Ajv, j £ Ajv,« 7^ j} over N and we consider a family of centered, variance 1, and independent, 
Gaussian random variables (Jij){i,j}e\* indexed by A^. The Hamiltonian of the model is given 
by 



H N (a) 



I 



2^/N . 



E 



JijO~iO~j . 



I A* I 



Notice that the sum extends over 

yN so that the central limit theorem is far from being applicable 2 



{«'-j}eAj, 
N(N — I) terms and that the normalisation is in 



The choice of Gaussian 



2 Depending on the computation in view, some other form of the Hamiltonian may be more appropriate, 
like, for instance, the form H' N (a) = — j— Yl JijCiCj- The two forms H and H' are thermodynamically 

V l<i<j<N 



variables is done for computational convenience; it is believed that any symmetric distribution 
with finite moments should lead to the same behaviour. Since the interactions are random, the 
Hamiltonian is a random variable of the configurations. 

The Edwards- Anderson model: is defined on the (/-dimensional lattice. Consider the finite 
lattice volume Ajv = [— N, N] d nZ . The dual lattice A* N is defined as usual and can be identified 
with the set A* N = {{z, j},z £ Ajv, j £ Z , |z — j| = f}. For a family of centered, variance f, 
independent, Gaussian random variables (Jij){i,j}e\* indexed by A* N} the hamiltonian is defined 
by 

Obviously, this nearest neighbour Hamiltonian is a random function of the configurations. 
For both models, the partition function is defined as usual by 

Z N = Y^ exp(-/3H N (a)) 

where the parameter f3 is the inverse temperature and for every fixed /3 it is a random variable. 
Similarly, the quenched free energy is defined by 

F N (P) = -±-\ogZ N (P) 

P 

and the quenched specific free energy by 

M/3) = 7^-7 W)- 
| Ajv | 

Both quantities are random variables. But contrary to the translation invariant case, taking 
expectation (average over the random variables J) of the partition function before computing 
the free energy, we can define a new quantity, the annealed free energy 

F N (P) = -^logEZ N (P) 

and the annealed specific free energy 

| Ajv | 

where E(-) denotes the average over randomness (ie average over the random variables J). 
In all the above definitions, special care has been taken in the signs and the normalisations 
appearing in various formulae; in particular, the sign and the normalisation of the free energy 
are those imposed by the laws of thermodynamics. Similarly, the minus sign in the exponent 
of the Boltmann factor, although irrelevant for probabilistic statements concerning symmetric 



equivalent; they can be made equivalent in dynamical respects as well if the interaction matrix J = (Jij)ij is 
choosen symmetric. 
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distributions, is there to remind the reader that physically the most probable configurations 
are those minimising the Hamiltonian and not those maximising it! 

Thermodynamic averages are computed through the random "Gibbs" measure 

exp(-/3H N (a)) 



/^v,/?(c) 



Z N (P) 



and are usually denoted, in the physical literature, by ( • )jv,/3 5 the precise meaning of this 
symbol 3 being 

(•)n,p = (-)fiNA d<T )- 



Notice however that for the mean held models, this measure does not give rise to an infinite 
volume Gibbs measure in the sense of Dobrushin-Lanford-Ruelle but only in the weak sense 
[4, 13]. 

For translation invariant systems, a phase transition is characterised by the change of an 
order parameter that can be chosen to be the magnetisation per site. In disordered systems, this 
is a random quantity so that an average over randomness must be taken. However, the average 
over the magnetisation vanishes due to the symmetry of the random variables J. Various order 
parameters have been introduced, starting from the Edwards- Anderson one [39]; the smoother 
seems to be the one defined in [41] by 

q N = TTl X ^(VNAvi) 2 )- 



3 Heuristic results on the Sherrington-Kirkpatrick model 

The study of the Sherrington-Kirkpatrick model proved rather complicated. The main difficulty 
stems from the nonlinearity of the logarithm function appearing in the expression for the 
quenched free energy. As a matter of fact, it is an elementary observation that 

Z R - 1 
logZ^Jim^— . 

So, in [39] and later in [127, 77], a trick was proposed to overcome this difficulty: instead of 
computing ElogZjv, it is advised to compute EZ^ where R is the number of replicas of the 
model, ie independent (in a) copies of the model all having the same random interactions J. So 
for R a positive integer, this reduces to computation of the moments of the partition function. 
Eventually, the computations for integer positive values are extended to zero; this is the famous 
replica trick. The hrst steps of this computation are given below. Fix some positive integer R 



3 In this paper the symbol ( • } is used later to denote the previsible increasing process of the Doob's decom- 
position of a submartingale. Therefore, we stick to the symbol jjl for Gibbs' averages to avoid any confusion. 



and compute 



EZ« = E Eexp(^E J .w)l R 



*i<, 



/3 2 R 2 ^ f3 2 



E exp(£-BE^? 

7 i...<tR ^ iV «,7 «' 



» , » - 7\2 

exp' ' x ~™' *■>■». - ->> 



where lower (Roman) indices stand for sites and take values in Ajv and upper (Greek) indices 
stand for replicated copies and take values in {1, • • • , R}. 

Now use the elementary identity 

1 f°° Q 2 ) — 
exp(Aa ) = —j=- j exp( \- \2\aQ)dQ 

to linearise the exponent appearing in the integral for EZ§ and write finally 

EZ§ = Jexp(-NA(Q))l[dQ c 



' «7 
"7^7 

where A(Q) is an effective free energy given by 

A(Q) = -^ + \ £ Ql, - log ^ep(Q), 

a, 7 

and where 

Zrep(Q) = ^ exp(--^(5„ 7 s„s 7 ) 

si,---,sr a ,7 

represents an effective partition function over the replica space. Notice that up to this point, 
the computations presented are absolutely rigorous. 

Assume now that the following, totally unjustified, statements are true: 

• the limit R — > does have a meaning, 

• the limits R — > and N — > oo commute, 

• all integrals converge in the limit, and 

• since the functional A(Q) is invariant under the symmetric group Sr over the replicas, 
so is the solution q = argminA(Q). 

Under these assumptions, it is shown in [127, 77] that in the infinite volume limit, the solution 
for the free energy is given by 



U = /^(l - q) 2 - -=- / exp(-z 2 /2)log[2cosh(/3^)]J2 

\/ Ztt/j 



where the quantity q plays the role of an order parameter and is given by the mean held 
self-consistent equation 



1 f°° 
q = , — / exp(— z / c l)i&vtii{ft^[qz)dz 
\/2tt8 J-oo 



/2tt/3 

and f ^ = —ft/A is the annealed free energy. The implicit equation for q cannot be solved in 
general; notice however that for small values of /3, actually (3 < 1, the only possible solution 
is q = 0. This implies that at high temperature and in the replica approximation scheme the 
quenched free energy coincides with the annealed free energy. For (3 > 1, there is a strictly 
positive solution implying that, at low temperature, there is a non vanishing value for q so 
that it can be interpreted as an order parameter; moreover, the annealed and quenched free 
energies do not coincide. What is remarkable is that these very naive computations reproduce 
roughly the qualitative behaviour of the model as it can be obtained from computer simula- 
tions. Of course, one does not expect that such an approximation may faithfully reproduce 
the exact quantitative behaviour and as a matter of fact, there is a severe problem with the 
solution at zero temperature: the value of the free energy predicted by the replica trick at zero 
temperature violates the laws of thermodynamics since it corresponds to negative entropy for 
the Sherrington-Kirkpatrick model. 

What is even more remarkable is that adding some even more unjustified assumptions than 
the previous ones, Parisi [108, 109, 110, 111] obtained an even more plausible heuristic solution. 
The Parisi's Ansatz stems from the observation that, as usual in the context of phase transition, 
there is a breaking of the symmetry group. Since the only symmetry group available here is 
the full symmetric group Sr over replicas, it is worth breaking it. Assume that the solution q 
found previously is not a minimum but a saddle point. Making his Ansatz, Paris fixes some 
integer m with < m < R that is a divisor of R (mind that eventually R goes to zero!) and 
searches for minimising solutions of the form 



*>% ctq 



9i ^ £]?M£] 



where [•] denotes the integer part. Repeat now the computations for the infinite volume free 
energy. The behaviour predicted now is much more reasonable and there is almost no violation 
of the thermodynamic laws. Parisi proposed even to continue the replica symmetry breaking 
to more than one levels. He claims even that eventually, a continuous function q(x) must be 
introduced to index the minimising solution. This infinite replica symmetry breaking induces 
an ultrametric structure to the space of states [100]. 

These results not only lack any rigorous justification but even their formulation in math- 
ematical language is problematic. Quite surprisingly, there is an alternative heuristic formu- 
lation, known as cavity method [101], that predicts similar (non rigorous) results, confirming 
thus, by another method, the results of Parisi. 

In the following figure the low temperature behaviour of the specific free energy for the 
Sherrington-Kirkpatrick model within one breaking of the replica symmetry is plotted as a 
function of the temperature. 
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Figure 3: The solid curve represents the value of the specific free energy of the Sherrington- 
Kirkpatrick model, as predicted by the one replica symmetry breaking computation of [109], 
as a function of the temperature T, for the low temperature regime T < 1. The gray 
region delimits the region where the specific free energy can lie, provided it exists, and it 
is computed from the rigorous upper bound for lim sup^y /jy of [1] and one of the infinite 
family of rigorous lower bounds for lim infjv /jv of [83] best at very low temperature and the 
rigorous bound of [31] best at intermediate temperatures. No optimisation over the known 
bounds is performed neither any use of convexity properties is made to delimit the gray 



The reader can observe how plausible this solution looks compared with the rigorous results. 

Mathematical results for the Sherrington-Kirkpatrick 
model 



In spite of continuing efforts, only partial results are known on this model. The hrst results 
were obtained with standard methods of mathematical physics, namely expansions. Almost 
simultaneously, in 1987, using cluster expansion [51, 53, 54] or graph expansion [1] the high 
temperature regime was almost completely understood. In [51, 53, 54], various important 
results concerning the very high temperature region are obtained. It seems to the author that 
the article [1] is however more complete in the sense that it covers the whole high temperature 
region and obtains some very partial results in the low temperature regime. In 1993, a totally 
new approach [30], using stochastic calculus, is introduced to tackle the model. Although no 
fundamentally new results were obtained with this last method, it has the merit of introducing 
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a totally fresh way of treating the problem. However, both expansion and stochastic methods 
proved unable, up to the moment these lines are written, to overcome the singularity of f3 = 1 
that has different origins in the two methods: for expansion methods, it corresponds to the 
radius of convergence of power series, for stochastic calculus, it stems from the explosion of the 
autocovariance of the process. Therefore, for the moment, only the high temperature region is 
accessible. It is not intended to give here a complete report on these two important approaches 
but only the flavour of the methods and direct the interested reader to the original papers. 

The main result of [I] is formulated in terms of the parameter r defined by 

2 
TN ^ = N(N-l) ^VnAviVj) 2 

that is a kind of order parameter for spin correlations. 

Theorem 4.1 For every (3 < 1, 

1. limjv^ 00 Erj V (/3) = ; 

2. limjv^oo jjElog Z N (f3) = limjv-oo ^ logEZ N (/3), 

3. Zn/~EZn converges in distribution, when N — > oo ; to the random variable exp(V — v 2 /2) 
where V is distributed according to J\f(0 } v 2 ) and v 2 = — [log(l — f3 2 ) + f3 2 — /3 4 /4]/2. 

Sketch of the proof: (For the details see [I]). It is enough to prove the convergence in distribution 
of Zjv/EZjv for then the second claim follows immediately and then it is not hard to show that 
the hrst claim also holds. Rewrite 

z N = J2 ex p[^77 J2 Jaws] = (II cosh -7§)z N , 



where 



z N = X] IK 1 + a i a j taim 



i<j v N 



Expand now the product, assigning a random weight w^ = tanh — t=± to every pair b = ij , and 
perform the sum over a. Remark that this sum is symmetric so that only terms where cr 8 's 
appear an even number of times, for every z, remain. It is convenient to visualise the sum in 
terms of graphs over the sites. Every vertex is labelled by a site z, a bond connects two distinct 
vertices and carries the corresponding random weight; each vertex i has as many cr 8 's attached 
as its graph degree (ie the number of bonds emanating from the vertex). Due to the symmetry 
of the sum, mentioned above, only (simple or multiple) loops remain in this expansion and the 
quantity Z^j can be expanded pictorially as 



II 




} simple loops 



£%5~\-r -f ^^j\ + ... } multiple loops 



Looking at the graphs of this expansion, one observes that the multiple loops appearing 
there are just the gluing of simple graphs; this is called an exponential family 4 in combinatorial 
theory [90, 135]. Denoting by Vjy = Z^simpie loops ^(7) the sum of the contributions over the 
simple loops, then the complete sum can be written Zjv = exp(V)v — small corrections). 

The rest of the proof reposes on one simple idea: we are interested on the infinite volume 
limit; thus provided that taking the limit N — > 00 does not lead out of the convergence domain 
of the power series, we can start by taking this limit to get the asymptotic behaviour. This 
idea is used several times in the proof. We illustrate it by proving a very simple intermediate 
result, namely that EV^ = v 2 . In fact, write 

v N = e ^(7) = E E ^(7) 

7:simple loops A;>3 {7:|7| = A;} 

where we have splitted the sum over simple loops into a sum of all possible lengths of simple 
loops (hence the condition k > 3) and into a sum over simple loops of given length. Now tanh(-) 
is an odd function and the variables J 8J are symmetric; hence the random variables w(^)w(^') 
are orthogonal if the loops 7 and 7' differ by at least one bond. Therefore, 

ev# = E E M7) 2 

fc>3{ 7 :| 7 | = fc} 

k [ { VN n 2k 

E — 

k>3 2 ^ 

= _i log(1 _ /3V ^_£. 

2 51 H ) 2 4 



4 As a matter of fact this is not exactly an exponential family since no double bond is allowed in the multiple 
loops; this constraint introduces a slight correction in the exponentiation formula for the generating function. 
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The passage to the second line in the above formula is justified by the independence and 
identical distribution of the random variables (Jij) and by a simple combinatorial argument 
counting the number of length k simple loops over N possible sites: fixing a vertex of the loop 
that should be called "the hrst vertex" and a sense of rotation, there are N possible sites that 
can give their label to the hrst vertex, N — 1 for the second vertex until the exhaustion of the 
loop (hence the numerator). Now there are 2 possible rotation directions and k possible hrst 
vertices (hence the denominator). 

Arguments of the same kind are then used to show that Vjy tends, in distribution to a 
centered Gaussian random variable of variance v 2 and finally prove the theorem. □ 

This expansion method is powerful and rigorous inside the convergence domain of the power 
series. It looks quite natural for a physicist and uses only elementary mathematics. On the 
counterpart, it can be very cumbersome. 

The same authors obtain also some low temperature results and particularly the following 

Theorem 4.2 For f3 sufficiently larger than 1, 

liminfr JV (/3) = I - 0(1/ P). 

N — ► oo 

This proves that if the limit exist, r is an order parameter for the model and the different values 
taken in low and high temperatures indicate the existence of a phase transition. 

We come now to the result proved by the method of [30]. The main idea is the observation 
that Zjv/EZjv can be expressed as an exponential martingale in the parameter f3 2 . The idea 
to use martingales in the context of statistical mechanics is, quite surprisingly, in a paper that 
does not deal with statistical mechanics at all but with a simple model for turbulence [74]; 
this model was extended in [29] to include temperature and in this latter paper, the ratio 
Zjv/IEZjv was expressed as a martingale in N. Now when a martingale in the volume appears, 
the martingale convergence theorem gives immediately the thermodynamic limit. Here the 
martingale character only serves to guess the correct form of the limiting behaviour; the study 
of the thermodynamic limits necessitating a more detailed treatment. 

The starting point is the Hamiltonian of the Sherrington-Kirkpatrick model, where the 
inverse temperature is incorporated into the Hamiltonian, 

H N (p-a) = ^EtI^- 

Since the random variables are distributed according to A/"(0, 1), the above Hamiltonian is a 
Gaussian process indexed by the configurations whose covariance is given by 

E[H N (P;v)H N (P;v')] = ^£(^)(<^)- 

i<3 
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Introduce now a family of independent standard Brownian motions (Bij) indexed by the 
bonds ij and define a modified Hamiltonian by 

Computing the covariance matrix for the modified process, we find 

E[H N (t;a)H N (t;a')] = ^£(^)(^)- 

Therefore, choosing t = f3 2 the two processes are indistinguishable. Denoting by 

T t = (j{B tJ {s)- l<i<j<N;s<t}, 

we remark that Hj^it) is a square integrable martingale with respect to Tt and therefore, for 
every fixed configuration <r, exp[i7jy(t) — {Hn )(t)/2] is also a martingale with respect to the 
same cr-algebra, (i7jy)(t) being the compensating process of the submartingale H^it). The 
important point is that the martingale character remains valid for the sum over configurations, 
so that 

is a martingale having the same distribution with the random variable Zn/~EZn. 

Theorem 4.3 Fort £ [0, 1[ ; the random process Kpj (t) converges in distribution to the process 
exp(M(t) — ^p); where (f)(t) = flog (7^7 — t), and M(-) is a centered Gaussian process with 
independent increments and such that, for < s < t < 1, 

EKM^t) - M^s)) 2 } = exp(<P(t) - </>(s)). 
Sketch of the proof: (For details see [30]). Remark that 

hm t nKNitf) = { eMm s : \ < ! 

jv^oo loo si r > 1. 

The martingale Kj^it) is in fact an exponential martingale that can be written in terms of 
another stochastic process Mj^it) as 

K N (t) = exp (M N (t) - ^M) . 

It turns out that Kj^it) is a local martingale that solves the stochastic differential equation 

dK N (t) = K N (t)dM N (t) 
and whose quadratic variation verifies the differential inequality 

d , ,, w , N- 1 

S (AMC)< — 
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Integrating this inequality, one obviously obtains that Afjv(t) is an L -martingale with EiW^(i) < 
t(N — l)/2. The most technical part of the proof consists in showing that ( Afjy )(t) converges in 
probability, as N — > oo, and for t < 1 to a deterministic function <f>. First remark that ( Afjy )(t) 
is a strictly increasing process going to +00 as t — > 00. Therefore, there exists a standard Brow- 
nian motion b on IR such that Afjv(t) can be represented as the value of b at the random time 
(M N )(t), le 

M N (t) = b((M N )(t)). 

Next remark that for every a > and every e > 0, 

f({-b(t) <a + et/2,Vt > 0}) > 1 - exp(-ae). 

The proof of this technical step is achieved by establishing that for every T < 1, every a > 0, 
and every e > 0, 

lim E(li A M e sup \F £ ((M N )(t)-<j>(t)\) = 0, 

JV^oo a ' £ 0<t<T 

where A^ t = {-M N (t) < a + e(M N )(t)/2} and F e (x) = [1 - exp(-(l + e)x)]/(l + e). Since 
P(A^J can be chosen arbitrarily close to 1, this proves the convergence in probability of 
( Mjv )(t) to the deterministic function <f>. 

Using now this fact and the Rebolledo theorem, it is shown that for t £ [0, 1[, the martin- 
gale Mjv(-) converges in distribution to a centered Gaussian process Af 00 (-) with independent 
increments such that for < s < t < 1, 

EKM^t) - M^s)) 2 } = exp(<P(t) - <P(s)). 

Therefore, the random process Kj^it) converges in distribution, for t £ [0, 1[, to the process 

expCJM*)-^) 
and thus the main theorem of [1] is recovered by using purely probabilistic arguments. □ 

The other mathematical result known about the Sherrington-Kirkpatrick model concerns 
the weak self- averaging property of the specific free energy. Self-averaging is a very important 
property of thermodynamic functions; when it is true, it states that the corresponding function 
is a trivial random variable in the sense that it does not fluctuate from sample to sample. The 
hrst result, valid on the whole region of temperature, was established by Pastur and Shcherbina 
in a weak sense in [115]: they proved the following concentration result: 



Theorem 4.4 For every f3 > 0, 



lim E[f N - Ef N } 2 = 0. 

N — ► 00 



Notice that this theorem does not guarantee the existence of the thermodynamic limit, limjv E/jv, 
which may not exist in low temperature. But provided that the limit of this expectation exists, 
the previous result says that the quadratic fluctuations vanish at the thermodynamic limit. 
Their method was subsequently applied to the Hopheld model and finer and finer results were 
obtained as time passed [131, 126, 13]. Moreover, the more recent result of [13] applies to both 
the Hopheld and the Sherrington-Kirkpatrick model to yield the following 
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Theorem 4.5 For every f3 > and every z > ; 

z 2 N, 



P(|/ JV -E/ JV |>z)<2exp( 



Notice that even this strongest version of weak self- averaging does not guarantee the existence 
of linijv^oo E/jv, but provided this limit exists, use of the Borel-Cantelli lemma suffices to show 
that the specific free energy is almost surely a self- averaging quantity. 

Sketch of the proof of theorem J f .5: First, order the bonds in A* N according to some arbitrary 
order (eg lexicographic) and write Hn(o~) = — j= Ybea* Jb&b where for a bond B = ij in A* N 
we denote by Jb = Jij and o~b = CiCj. Now hx some bond K G {1 , • • • , |A^|} and a parameter 
t G [0, f] and write a modified Hamiltonian 

H N (a;t,K) = j= ^ J B cr B -=J K a K . 

Viv B+K ViV 

Since the Hamiltonian is now depending on the two additional parameters t and K, all the 
thermodynamic functions, and the free energy Fw(t, K) in particular, depend also on these two 
parameters. Notice that Fn(1,K) = Fn- Compute now the derivative with respect to t: 

dF N (t,K) _ j/ft_y^ exp[-/3H N (a;t,K)] 
It " 7N V ° K Z N (t,K) ' 

Observe that the sum over a is just the Gibbs average of the values of spin over the ends of the 
bond K and hence takes values in [—1,1]; therefore 

l dF N (t,K) l < \J K \ 



dt ~ VA7 
Use an equality from elementary calculus to write 

F N = F N (1,K) = F N (0,K) + I' dFN ^ K) dt 

Jo dt 

and denote by Tk = ^i^i? ' ' ' ? Jk}- Now, 

i> K = E(F N \F K ) - EiFNlfK-!) 

= E(F N (0, K)\F K ) - E(Fjv(0, K)\r K -i) 

+ (\^{F' N {t,K)\TK) ~ nF' N (t,K)\r K -i)dt. 
Jo 

The crucial points are the use of the previous bound on the derivative of the free energy and 
the remark that, in the expression for Fn(0,K), what is measurable with respect to the o- 
algebra Tk is also measurable with respect to Tk-\- Finally, since Fn — EFjv = Y^k^k, an d 
IV'A'I ^ ~kj(\Ji<\ + E| Ja'|) the result is obtained by optimising the Markov inequality. □ 
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In parallel to these major results concerning the model there exist also some partial results 
concerning various quantities. Let us mention the result on the supremum of the Hamiltonian 
over configurations obtained in [128] that states: 

< Cl < liminf SUP ^ (a) < limsup SUP ^ (a) < C 2 < J^~2. 

N N ~ N N v 6 

This result is weaker than the corresponding result contained in equations 2.20 and 2.23 of [1]. 
Its interest stems in the method with which it was obtained: a comparison of Gaussian processes 
by Slepian's lemma [88] and a Gilbert-Varshamov bound [92] from information theory are used. 
In my opinion this is an interesting direction to search for obtaining new results in the spin glass 
models. In particular, the behaviour of Gaussian processes indexed by the spin configurations, 
in terms of geometrical properties of the configuration space, must be understood. 

Other results concern bounds for the limes infimum and limes superior of the specific free 
energy valid in the low temperature region (/3 > 1). These results are scattered through four 
different sources [1, 83, 31, 99] that are presented here as a single theorem: 

Theorem 4.6 For all f3 > 1, we have, in distribution, the following inequalities 

—g{fi) < liminf /jv < limsup/jy < ~h(/3) 

N N 

where g(/3) = g\(/3) A </2(/3) and 

log 2 



5l (/3) = ; /log2 + 
92(P) = 1 + 



log 2 log p 3 



(3 2/3 4/3 



and 

log 2 If 1 
h(P) = — / logcosnim/ — )au. 



f 1 f^u 

/ log cosh (/?W — )di 

Jo V ^ 



In spite of the efforts to prove the existence of the specific free energy for this model up to now, 
such a proof is still missing nowadays. But if this limit exists, it must necessarily be a trivial 
random variable in the sense that it coincides with its expectation as it is shown in [13]. The 
bounds obtained in this theorem are used to delimit the gray region of figure 3; as a matter of 
fact, there is an infinite family of available bounds for the very low temperature regime and §\ 
must be optimised over all these bounds. Not to burden the presentation, I give here only the 
easier linear bound for §\. 

Proof of the theorem: The simplest bound §\ from those in [83] is obtained as follows: denote 
by Ajv(c) the configuration dependent event 

A N (a) = {exp(^L J2 JiiWi) < exp(f (N - 1))}. 
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Then by Chebyshev inequality, the probability of the configuration independent event Bn = 
U (7 Ajv(c) c tends to zero, provided that f3\ > 2-^/log 2, hence B N has full measure. On the set 



'N 



Z N (P) = Eexp(-^E^W) < 2 Jv exp(^(JV- 1)) 

ViV l<3 I 

and therefore 

w) = mf (— + ——) = Vlog 2 + ——. 

,3 1 >2 v /log2 z P P 

The bound for g 2 is obtained in [31], some ideas are also in [99, 61]. The specific free 
energy of the model is not changed by adding a finite, configuration independent term in the 
Hamiltonian. Thus, we use the Hamiltonian Hn-, defined on Ejv = { — 1,1}^, given by the 
formula 

H N {a) = -= J2 JijWj ~ —qFf J2 J ™ a h 

where (Ju) is a family of independent A/"(0, 1) random variables. This Hamiltonian leads to 
the same specific free energy (mind that a\ = 1 hence the extraneous term is configuration 
independent and -4= J2i Ju = A/"(0, 1) in distribution.) 

Let M = (Mij) be a symmetric N X N matrix with 

m v = \w j ; 3 !! i <j . OTi>j 

l v^ J " lf l = J - 

This matrix has almost surely simple eigenvalues Ai < • • • Ajv with normalised eigenvectors 
(f) 1 , ■ ■ ■ ,(f) N . Since the distribution of M is invariant under orthogonal transformations, the 
diagonal matrix 

( Xl \ 

A = 

V X N ) 

is independent of the orthogonal matrix ((f) 1 , • • • , (f> N ) and we may choose the frame (f> such that 
it should be uniformly distributed on the set 0(N) of orthogonal matrices. In particular, for 
every positive measurable function F, we have 



E[F(M)|A] = f F(<f>A<f> T )K(d<f>) P-a.s. 



where k is the uniform probability on 0(N). Change now the configuration space Ejv = 
{ — 1,1}^ into the sphere Sn = {s G K : |s| 2 = J2i=i s "i = N} and define a new model 
(termed spherical model) with the same functional form for the Hamiltonian but defined over 
the configuration space Sn- Its partition function is given by 

Z N h = / exp(-f3H N (s))v N (ds), 

where vn is the uniform probability on the sphere Sn- 
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The main point is the domination of the Sherrington-Kirkpatrick model by the spherical 
model; for any fixed configuration a £ Ejv, the distribution of the scalar products (<r, cf> 1 ) under 
k is v and hence, 

E(Z N \A) = Z%\ 

Now this model is soluble and its specific free energy is explicitly bounded by —g2(/3) where 
g 2 (/3) = -l- log 2//3 + log /3/2/3 + 3/4/3. 

It remains now to show the upper bound, obtained in [I, 99]. Start from a sequential 
algorithm for obtaining configurations that optimise this upper bound. For a fixed set of 
couplings (Jij), associate with each spin configuration a a new configuration r\ by 



r]i(a,J) = cti 



a i s g n Ei=l Jij a i ^ E;=l Jij a i ¥" 



' 1 cri(Tj otherwise. 



The Hamiltonian can now be expressed as 

Hn(v) = ~ Yl Ak(o; J)r]k{cr, J) 



with Ak(<J, J) = Ei=i ~7h (J i • Define Th = &{Jij] i < j < k} and remark that conditionally to 
Th-, the sum EiJi 1 Jij&i follows a A/"(0, k — I) law, hence conditionally to Th-, 



r(A k £ da) _ I 7A% ex P(-^T^) for a ^° 
da \ for a < 0. 

Moreover, for fixed couplings (J 8J ), remark that the map cr i — > 77 is invertible and denote by 

E(?l) = — Efc=i ctkVk where a 1 // = EA^ ~ y~~N^- Use now a standard variational principle to 
express 

log Z N (/3) = sup{- J2 P{°) lo S P{°) ~ P J2 Pi^HN^)} 

the supremum being over probability measures over the configurations. For a given set (J 8J ), 
consider pier) = e J; ' where 

N 

Z* N = Y,eM-PE(ri(<T,J))) = Y,eM-PE(ri)) = 2 N ]J cosh(/3a£). 

Therefore, 

— log Z N > — log Z* N - Q N 

n (n\ & Y-exp(-/^jv(^)) r , , ,, , „ 

It is quite straightforward to show (see lemma 5.1 of [I]) that limy Qn = and on the other 
hand to estimate the value of 0?, N N by elementary methods, hence the explicit form for h given 
in the statement of the theorem immediately follows. □ 
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where 



Finally, let us mention the results in [66, 67, 68] where only elementary probabilistic methods 
like Chebyshev inequalities are used to obtain certain high temperature results and where 
mathematical considerations in combination with some Ansdtze are used to recover the Parisi 
solution. 



5 Mathematical results for the Edwards- Anderson model 



Contrary to the Sherrington-Kirkpatrick model, that is a mean held model, the Edwards- 
Anderson spin glass is a short range system; as such it is believed to modelise more faithfully 
the physical reality than the previous model. On the counterpart, some of its features are more 
complicated. Therefore much fewer rigorous results are known. 



The hrst result is the following 



Theorem 5.1 For every f3 > and every dimension d, the 



Jim In = fo 

1 V — ► oo 



exists and is non random. 



Proof: an exercise on the law of large numbers! If you are lazy enough to do it, look at [130, 63]. 
□ 

All the other features of the model are much more complicated. Especially the structure of 
the Gibbs states is still very controversial. Namely, there are two different ways arguing: the 
tenants of the Parisi's way of thinking [102, 94, 95], based on the analogy with the Sherrington- 
Kirkpatrick model and on numerical simulations, claim that, at low temperature, the Edwards- 
Anderson model has infinitely many pure states like a genuine spin glass. On the other hand, 
the followers of the Fisher's and Huse's way of thinking, based on scaling arguments, claim 
that there are at most two pure phases at low temperature connected by symmetry [48]. The 
rigorous results obtained so far [40, 81] do not allow to settle the controversy. 

It seems that one of the problems of the model is that, contrary to mean held systems, the 
annealed free energy is not a good starting point, even at high temperature, in the sense of the 
following 

Theorem 5.2 For every f3 > and every dimension d, the strict inequality 

J CO > Joo 

holds. 

A non strict inequality immediately follows from the concavity of the logarithm function 
and the Jensen inequality. Some indication in the direction of strict inequality is given in 
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and this fact was proven in [81] for Gaussian variables and in [32] for ±1 Bernoulli variables. 
Here an elegant unpublished proof, due to Varadhan [129], valid for Gaussian variables is given. 

Proof: Instead of using the usual definition for the partition function, use a normalised partition 
function 

Zn = ^m ^ exp ^ ^ J^^j)- 

This definition introduces an irrelevant constant shift of the free energy but has the advantage to 
replace the counting measure over configurations by a uniform probability on the configuration 
space. Consider the set 

2d \^\ {l , j} eA* N 

Using Markov inequality, it is easy to show that for every e > 0, we have limjvP(^) = anc ^ 
hence that the set A t has full measure in the thermodynamic limit. Using this remark, we can 
show that 

lim — — rElogZjv = lim— — :E(li^ log Zn). 

n \A N \ n \A N \ 



Using the trivial identity 



we can compute 



l=exp(-^£j2)exp(A£j- 



E(A Ae logZ N ) = -^Elli^log^^exp^^J^a^-)]) 



|AjV| |YYJV 

< 



^e ^log^E^p^E^-^, - ^E^W^ia + e ))] 



|A 

Now Jensen's inequality can be used, explicit integration over the Gaussian variables performed, 
the limit e — > taken, and the optimisation with respect to the parameter A done, to obtain, 
on the set A e , 

lim-^Elog^ < ^[^1 +4/3^-1 -log! 1 + V1+4/32 ] 

< dB 2 = lim — — log EZ N . 

n \A N \ 

D 



6 Other results on the Edwards- Anderson model 



Besides the mathematical results presented previously, there are also extensive numerical sim- 
ulations on this or other, closely related models, that aim to prove (or disprove) the claims of 
the tenants of the Parisi's school. The early computer simulations were quite imprecise since 
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they largely underestimated the relaxation phenomena [106]. Recently, much more precise large 
scale simulation are performed [22, 93]. 

The intuitive picture Parisi has of the low temperature phase structure is that there are 
several pure phases, denoted by Greek indices in the sequel. Each phase a corresponds to an 
extremal Gibbs state {it a measure with respect to which thermal averages //«(•) are computed). 



An interesting quantity to compute is the overlap parameter q ai 



1 T N a 



N 



{a i )fi 1 (a i ). In the 



low temperature phase, there is a mixture of such pure phases, each phase contributing with a 
weight W a . For every realisation of the randomness, compute the probability distribution 

P^{dq) = P( ?a7 e[q,q + dq])^^2 W a W J 6{q aj - q)dq. 



a, 7 



The important point is that the weights W are supposed to be random variables, even in the 
thermodynamic limit, it they are not self averaged (sample dependent) quantities. This belief is 
in the crux of the Parisi's solution and is slightly supported by the numerical evidence. Taking 
an average of the probability density for q ai over various realisations of the randomness, a 
probability measure having continuous distribution down to is numerically obtained. In the 
figure below, numerical results on the averaged probability distribution are quoted from [22]. 




Figure 4: This figure represents the averaged over the randomness probability density for q. The solid line 
represents the high temperature (T > 1) distribution and the dashed one the low temperature (T < 1) 
distribution. The results are from [22] and correspond to several hundreds of hours of computer time 
of Monte Carlo simulations on a finite systems supposed to be so large that the thermodynamic limit is 
attained. What is meant by 'large' depends on the computer budget your laboratory disposes and in the 
present case it means exactly a box of 15 x 15 x 15 sites. We remark that the high temperature distribution 
is — quite astonishingly — not symmetric around and that the low temperature one develops a small 
but strictly positive density in the negative axis. This may be due to the small size of the system that 
feels the boundary condition. In spite of the enormous amount of computer time needed to produce such 
a figure, in contrast to similar simulations on deterministic systems, it only qualitatively suggests that 
there is a phase transition. 

The continuous distribution extending down to is interpreted as the lack of self-averagness. 
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In a recent paper by Newman and Stein [105] it was argued that this picture cannot be correct for 
the Edwards- Anderson model. These authors proved that if the liniv Pjy exists before averaging 
over realisations of J's (as it is claimed in the Parisi's conjectures), then it is automatically 
self- averaged. Now the numerical evidence and the Parisi's claims seem to show that "Iimjv"-Pjv 
is not self- averaged. Therefore, if this quantity is not self- averaged it merely does not exist (ie 
the thermodynamic limit does not exist). If the limit does not exist this is the signature of a 
chaotic dependence of Pj^ that is consistent only with an infinite range model. So, it is claimed 
that this picture of infinitely many low temperature pure phases is inconsistent with the finite 
range of interactions of the Edwards-Anderson model. So as time passes, it seems that the 
nature of the low temperature phases of the model gets more and more controversial. 



7 Conclusion 



I should like to close this survey at this controversial point. It is not possible in the limited 
space of this survey to treat very interesting related problems. For instance the more realistic 
quantum case is completely left out of this review. 

It is shown in the introduction of this paper that the disordered systems might be thermody- 
namically out of equilibrium. An interesting fundamental question should be to ask how these 
systems evolve in time, how the equilibrium is reached and what are the mechanisms of the 
the metastability that has been observed experimentally. Some of these questions have started 
to be adressed nowadays, especially using numerical methods. The mathematically rigorous 
study of dynamics that became quite sophisticated for deterministic systems [79, 96, 97, 98] is 
still in en embryonic stage of development. 

Important connections of the statistical mechanics of disordered systems with the spectral 
theory of random operators [114] are also almost absent from this paper. One reason is that 
there is an excellent review by Pastur [112] dealing with these topics. The other reason is that 
such an exposition of this direction, should invariably lead us to another closely related terra 
incongnita, namely random walks in random environments that deserves a review by its own 
(see [123, 16]). 

Finally, no account of recent developments in the theory of stochastic simulations is given. 
For an introduction to the topic one should look at [118] and for more specific developments in 
the context of spin glasses, one can consults the more specialised articles [86, 22]. 

Fresh results and theoretical advancements in this fascinating domain of spin glasses are 
still needed. 
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